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Abstract 

We formulate simple criteria for positive Harris recurrence of strongly degenerate stochastic 
differential equations with smooth coefficients on a state space with certain boundary conditions. 

The drift depends on time and space and is periodic in the time argument. There is no time 
dependence in the diffusion coefficient. Control systems play a key role, and we prove a new 
localized version of the support theorem. Beyond existence of some Lyapunov function, we only 
need one attainable inner point of full weak Hoermander dimension. 

Our motivation comes from a stochastic Hodgkin-Huxley model for a spiking neuron including 
its dendritic input. This input carries some deterministic periodic signal coded in its drift coefficient 
and is the only source of noise for the whole system. We have a 5d SDE driven by lcl Brownian 
motion. As an application of the general results above, we can prove positive Harris recurrence. 

Here analyticity of the coefficients and Nummelin splitting allow to formulate a Glivenko-Cantelli 
type theorem for the interspike intervals. 
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1 Introduction 


Consider a d-dimensional diffusion driven by m-dimensional Brownian motion 


( 1 ) 


dX t = b{t,X t )dt + o(X t )dW t , t> 0 


where m < d, with smooth (and sometimes even analytic) coefficients 


( 2 ) 
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We require that the coefficients be such that for every starting point a unique strong solution exists 
and has infinite life time; the state space for process tfH> will be some Borel subset E of lR d with 
Borel-cr-field £, see Section [2TT1 satisfying certain boundary conditions. 


We are interested in Harris properties of the process X (which is non-homogeneous in time) under 
the assumption that the drift is periodic in the time argument, with main focus on case m < d 
where the SDE (jT]) is degenerate. Our criteria will be in terms of control systems and the support 
theorem -assuming principally that there exists one inner point of the state space which is of full 
weak Hoermander dimension and attainable in a sense of deterministic control- and in terms of some 
Lyapunov function. We use m for existence of smooth transition densities locally at the attainable 
point. 


Our assumptions on the state space and on the coefficients of the SDE’s are such that results which 
we prove for general degenerate SDE’s can be applied to stochastic Hodgkin-Huxley models where 
dendritic input is the only source of noise, and where a determinisitic T-periodic signal is encoded in 
the semigroup of the process. For such models we can establish positive Harris recurrence. 


Our main results in the general setting are positive Harris recurrence of strongly degenerate SDE’s 
(Theorem [lj) and a new localized version of the support theorem (Theorem [5]) adapted to the specific 
structure of our state space. For stochastic Hodgkin-Huxley models, we obtain the Harris property 
(Theorem [2]) from explicit construction of a Lyapunov function and of a control steering trajectories 
towards the attainable point. We do this for Cox-Ingersoll-Ross type input and for Ornstein-Uhlenbeck 
type input. In the latter case, we improve on [1TJ since we obtain a unique Harris set. We need the 
Harris property to give a sound mathematical meaning to ’’typical spiking behaviour of a neuron” 
in terms of long time behaviour, and prove convergence of empirical distribution functions for the 


2 






interspike times (Glivenko-Cantelli type Theorem [p by combining analyticity of the coefficients with 
the Harris property. 

The plan of the paper is as follows: the setting and the assumptions under which we are working 
are explained in Section 12.11 We give the main result on Harris recurrence of degenerate SDE’s in 
Section 12.21 its application to stochastic Hodgkin-Huxley systems in Sections 12.31 and 12.41 The proofs 
for degenerate SDE’s are in Sections 14.11 and 14.21 the proofs for stochastic Hodgkin-Huxley models in 
Section[5j Sections 13.1113.2113.41 andlfilcan be read independently: here we deal with weak Hoermander 
condition and we state the localized version of the control theorem, in a setting where the classical 
techniques apply only locally. 


2 Outline of results 


2.1 The setting and the assumptions 

We start with an example in order to motivate our main assumptions. 


Example 1 Consider the two dimensional process (X t )t >o defined by 


(3) 



d£t = — c sin 2 (27rt) dt + dB t 

dift = (1 - dt + fiit dB t 


where (B t )t >o is one dimensional Brownian motion. We have an explicit representation of the solution: 
& = £o e~ c fo sin2 ( 2 + Jj e~ c fr sin2 ( 2nv ) dv dB r for 0 < t < oo, and if t = (V’o + Jj Qfi'dr) 4> t where 
dh := e _t e St_ 2 t takes values in (0, oo). Notice that fio > 0 implies if t > 0 for all 0 < t < oo. Choosing 
E := lRx[0,oo) as state space for the process 15)1, d{E) n E is an entrance boundary of X. 


The structure of the state space described in Example [T] is typical for what we will consider in this 
paper. Our first standing assumption is 

Assumption 1 a) For some strictly increasing sequence (G m ) m of bounded convex open sets in ]R d 
and compacts C m := cl(G m ), we have E = (J C m and S := 13(E) . 

m 

b) d(E) 0 E is an entrance boundary for the process X. 

b’) From positions x € C m \ G m+ ±, almost surely, the process X immediately enters G m+ \. 

c) Defining stopping times T m := inf{t > 0 : X t ^ C m } for the process, we have T m f oo as m —>• oo 
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almost surely, for every choice of a starting point x € E. 
d) The components of coefficients |J|) for equation (QP 

(t, x ) —>• b l (t, x), x —>• a iJ (x), i = 1,..., d, j = 1,..., m 

are C°°— functions on ]R + x U, for some open set U C JR d which contains E. 

The above assumption combines properties of the process (such as non-explosion or behavior at the 
boundary) with topological properties of E. It might hold for suitable processes JT|) with E open in 
M d -thus d(E) n E = 0 in b)- for a compact exhaustion ( C m ) m of E in a), i.e. C m C G m+ 1 for all m. 
In case of Example 1, it holds with G m := (— m,m ) x (0,m) and E = JR x [0, oo) since the process 
Q starting in [—m,m\x{ 0} = C m \ G m+ \ immediately enters G m+ Assumption Q] will be what we 
need for the stochastic Hodgkin-Huxley system of Section 12.31 It implies in particular that (E,£) is a 
Polish space. The compacts C m = cl (G m ) are needed for various localization purposes. 

We write P s j(x,dy), 0 < s < t < oo, for the semigroup of transition probabilities on (E,£). For 
x € E and s > 0, we write Q( a>x ) for the law of the process (HJ) starting at time s in x, a probability 
on the path space := C([s,oo),E) with the topology of locally uniform convergence; then the Borel 
cr-field A is also generated by the coordinate projections, and (n,A) is again a Polish space. In case 
s = 0we write for short Q x := Q(o tX ), x £ E. Finally, we also denote by Qf the law of the solution 
(. X t )o<t<t 0 of ©, for a finite time horizon [0, to]; starting from Xo = x, on C([0, to], E). On (0,A), 
equipped with the canonical filtration G = (Qt)t >o and with shift operators {9t)t> o, X is simply the 
canonical process. 

Our second standing assumption is time-periodicity of the drift together with existence of a Lyapunov 
function which constitutes a first step towards Harris property. 

Assumption 2 a) We take the drift T-periodic in the time variable: 

b(t,x) = b{iT{t),x) , ir{t) '■= t modulo T . 

b) We have a Lyapunov function V : E —>• [l,oo) ; in the following sense: V is £-measurable; there is 
a compact K contained in E (i.e., K C E and K A E) and some e > 0 such that 

Pq,tV is bounded on K , Pq,tV < V — e on E\K . 


By Assumption [2] a), the semigroup of the process dTJ) is T-periodic in time which means that 

Ps,t(x,dy) = P s+kT ,t+kT(x,dy ) , k € JV 0 . 
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This implies that the T-skeleton chain {XkT)ke]N 0 is a time-homogeneous Markov chain. By Assump¬ 
tion [2] b), ( V(XkT))ke]No evolves as a nonnegative supermartingale as long as it stays outside K. 
As a consequence, the skeleton chain has to visit the compact K infinitely often, almost surely, for 
arbitrary choice of a starting point in E. We ask the following question: which additional condition 
grants that the T-skeleton chain is recurrent in the sense of Harris? 

The T-periodicity of the semigroup has another important consequence: as in the proof of Proposition 
5 in m, we will have equivalence of the Harris property for the d-dim skeleton chain (Xkx)kolNo an d 
of the Harris property for the (l+d)-dim continuous time process 

X = (X t ) t > o defined by X t := (i T (t), X t ) 

taking values in E := TT x E where TT := [0, T] is the torus, identifying t with ix{t)- E equipped with 
its Borel-cr-field £ is a Polish space. Time being included as a ’zero-component’ into the continuous¬ 
time process, X is homogeneous in time. For the Harris property in discrete time see Harris m and 
Revuz m p. 92, for the Harris property in continuous time see Azema, Duflo and Revuz [2]. The 
(unique up to constant multiples) invariant measures // of (Aifcr)fcew 0 and fi of A will be related by 

1 f T 

(4) n(dt,dx ) = — ds [e{ s }<8> /j,P 0 , s ](ds,dx) . 

1 Jo 

By the form of the Lyapunov condition in Assumption [2] b), recurrence will necessarily be positive 
recurrence: we thus will have n(E) < oo, and up to choice of a norming factor p will be a probability 
measure on (E,£), E C M d (cf. Meyn and Tweedie [2T] . Theorem 4.3). 

Next we introduce a notion of ‘attainable points’ for the process X. Note that this notion is entirely 
deterministic. Stratonovich drift &(■,•) is specified in (1181) . 

Definition 1 A point x* in E is called attainable in a sense of deterministic control if it belongs to 
int (E) and if the following holds: 

for arbitrary x € E, we can find some h in Lf oc (the class of m-dimensional measurable functions 
with components fif satisfying [h^(s)] 2 ds < oo for all t < oo, i = 1,..., m) depending on x and x* 
which drives the deterministic control system with Stratonovich drift &(•, •) 

dip(t) = b(t, ip(t))dt + a(ip(t))h(t)dt, 

from starting point ip(0) = x towards the limit x* = lim <p(t), under the constraint (p(t) € E for all 

£—>•00 

t > 0. In this case we set ip := . 
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An illustration in the framework of Example Q] is given below. We introduce our third key assumption, 
anticipating on Section f3. 21 where we define ‘full weak Hoermander dimension’ (Definition [3] in Section 
1531 does require some terminology, to be prepared there and to be read independently). 

Assumption 3 There is a point x* € int(E) with the following two properties: x* is of full weak 
Hoermander dimension (Definition 0 in Section \3.2\ below), and x* is attainable in a sense of deter¬ 
ministic control. 

Notice that in the above assumption, it is sufficient to verify the weak Hoermander condition at only 
one point x* € irk (A). This is easy for the process (0) of Example [T] (cf. end of this subsection and 
end of subsection m • For the stochastic Hodgkin-Huxley model of Section 12.31 we will be able to 
verify Assumption [3l 

At some point we will use a stronger version of Assumption [T] d) and suppose that the coefficients of 
(JT]) are real analytic functions. This will allow to establish that weak Hoermander dimension remains 
constant along control paths as considered in Definition [T] (which would not be true for C°° coefficients 
as considered so far). We introduce our last assumption, specific to the analytic case. 

Assumption 4 The components of coefficients 0) for equation 0) 

(f, x) —>• b l (t, x) , x—>a z ’ J (x) , i = 1,..., d , j = 1,..., m 
are real analytic functions on ITxU, for some open set U C HI' 1 which contains E. 

Example Q] continued Put d = 2, m = 1, and consider the 2-dim process 0) of Example^ driven by 
1-dim Brownian motion, with state space E = Mx [0, oo). Here the point x* := (0, |) is attainable in 
a sense of deterministic control. To check this, write t —>• £(i) for the first and t —>■ if (t) for the second 
component of a deterministic control system t —>■ cp( h, '’J(t) with h € L 2 oc . Write x = (,|) for points 
in E, £ G 1R, if € [0,oo). Put S(t ) := csm 2 {2itv)dv for t > 0. The process 0) has Stratonovich 
drift b(t,x) = ( csll )_ 3 2 / 7rt ^) ; from ITR) . We have to determine h € L? such that simultaneously for 
all choices of a starting value £(0) € JR, 

£(t) := £(0)e~ s ^ + f h{v)e~^ s ^~ s ^dv solution to —j - = —c sin 2 (27r t)£(t) + h(t) 

Jo dt 

converges to the limit value 0, and such that for all choices of a starting value 0) € [0, oo) the 
solution to 

~df^ = 1 “ f^ + 


6 




converges to | as t —>• oo. 77ie first requirement is satisfied whenever h is a smooth function on [0, oo) 
which decreases to 0 as t —>• oo. If we choose in particular h( 0) := 1 and h(t) = 0 for t > to, then 
T(t ) := Jq(| — h{v))dv is after time to a linear function, so as desired, 

ijj(t) := if>( 0)e -T(i ) + f e~^ T ^~ T ^dv —> f e~^ y dy = - as t ^ oo. 

Jo Jo 3 


2.2 Main results 


Now we can state the main results of our paper. They strengthen the results obtained in [ 14] . 


Theorem 1 Under Assumptions [TH3| the following holds: 

a) The skeleton chain (Xkr)ke]N 0 is positive Harris recurrent. 

b) The continuous-time process X = ((iT{t),X t )) t>0 is a positive Harris recurrent process. 

As a consequence of Theorem Q] and positive recurrence, see e.g. E3, E3, we obtain strong laws of 
large numbers. Note that by Hopfner and Kutoyants m, Section 2, there is a third equivalence to 
assertions a) or b) of Theorem [0 i.e. Harris recurrence of the T-segment chain ((Xf^r +s )o< s <T) k€ ^f , 
taking values in C([0,T], E), and with invariant measure as specified there. Actually, part b) of the 
following Corollary [T] is a strong law of large numbers for additive functionals of the T-segment chain, 
applying Theorem 2.1 of [15] . 


Corollary 1 a) Grant Assumptions [7\ [3] and consider functions G : E —>■ 1R which belong to L 1 (p), 
and functions F : E — ^ 1R which belong to L 1 (/l)- Then we have 


1 n r 

»S g(Xit) L 


M d 
T 


p(dy) G(y) Q x -almost surely as n —» oo 


- / F (i T (s),X s ) ds —> I ds [ [pP QtS ](dy) F(s,y) Q x -almost surely as t 

t Jo 1 Jo Jn d 


oo 


/0 ± Jo JIR d 

for arbitrary choice of a starting point x € E. 

b) The second assertion in a) can be extended to a—finite measures A (ds) on ()) which are 
T-periodic i.e. A (B) = A (B + kT ) for any B € B(M) and k € %, as follows: 

1 rt 


t 


f F (i T (s),X s ) A(ds) —> [ A (ds) [ [yP 0)S ](dy) F(s,y) Q x -almost surely as t 

Jo 1 Jo J M d 


OO 


provided the mapping [0,T] 3 s —> yPo tS \F(s, -)| belongs to T 1 (A). 
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In the analytic case, we obtain additionally to Theorem Q] and Corollary [TJ 


Proposition 1 Under Assumptions[l\\4\the following statements hold true. 

a) The weak Hoermander condition holds on the full state space E. 

b) The process (QP is a strong Feller process. 

c) The invariant probability n(dy) on E and the projection ^ / Q T ds [/iPo.s] (dy) of Ji(ds,dy) on its 
second component y G E admit Lebesgue densities. 

Theorem |T] will be proved in Section Id. II below, Proposition [T] in Section 14.21 


2.3 Application: stochastic Hodgkin-Huxley systems where dendritic input is the 
only source of randomness 


The classical deterministic 4d Hodgkin-Huxley model for a spiking neuron (Hodgkin and Huxley [11] ) 
consists of four variables: the voltage v taking values in M which can be measured by introducing 
an electrode into the soma of the neuron, and three gating variables n, m, h taking values in [0,1] 
which represent the probabilities that ‘guardians’ of certain types open certain types of ion channels. 
A deterministic function represents input as a function of time (e.g., a sequence of pulses). A modern 
introduction to the biological background can be found in the book by Izhikevich m We address 
here a stochastic Hodgkin-Huxley model including dendritic input, the latter being the only source of 
’’noise”. Practically we add as in [13] and m an autonomous stochastic differential equation as fifth 
component to the 4d model; its increments take the place of classical input terms and thus act on the 
membrane potential. Hence our stochastic Hodgkin-Huxley model is a 5d system 


X = (X t )t >o where X t has components vt, nt, mt, ht , ft, 


driven by Id Brownian motion W = (Wt)t >o as follows: 


(5) 


dv t = df t ~ F(v t ,n t , m t , h t ) dt 
< dj t = [aij(v t )(l - j t ) - Pj(v t )jt]dt 
dft = P{t, ft) dt + q(f t )dW t . 


j <E (n, m, h} 


The mapping (t, y) /3(t, y) is T-periodic in the time variable, for all y. Some T-periodic deterministic 
signal t —>• S(t) is coded in (3(t,y) and hence in the semigroup of (X t )t>o- The mapping y i->- q(y) is 
a Id volatility, strictly positive on the interval where (ft)t >o takes its values. We shall specify /?(•,•) 
and (/(•) below in two different -biologically relevant- ways. 



Without any change with respect to the deterministic Hodgkin-Huxley model, the function 
(6) F(v, n, m, h) := 36n 4 (u + 12) + 120 m 3 h (v - 120) + 0.3 (v - 10.6) 


in © is a power series in the four variables v, n, m, h. The mappings v —» a 3 (v) > 0 and v — >• (3j(v) > 0 
are real analytic having domain JR, the index j representing any of the variables n or m or h (see 
m pp. 37-38 for explicit expressions -those which we have used in m, on- and biological context). 
Since a-j(v) and /3j(v ) are strictly positive, solutions t —> nt , mt , ht starting in [0,1] will immediately 
enter the open interval (0,1) and remain there for all 0 < t < oo. This property allows to construct 
the state space E such that parts b) and b’) of Assumption |T] do hold. 


Deterministic Hodgkin-Huxley systems with constant input c € JR suppress the last equation from © 
and write the first four equations as 


(7) 


dvt = cdt — F(vt,nt,mt,ht) dtt 

djt = [aij(vt)(l - j t ) - Pj(v t ) j t ]dt , je{n,m,h}. 


In 4d systems ©, equilibria for the gating variables n, m, h whenever v is kept constant 

Q, ■ 

( 8 ) joo(v) := -, j€{n,m,h} 

aj + 13j 

exist, and the mapping defined by 


(9) v —» Foo(v) := F (v , n^v ), m^ (v ), (v)) 

turns out to be strictly increasing from JR onto itself. Defining v c € JR as the solution of F 00 (u c ) = c, 
we dispose of a 1-1-correspondence between values c € JR of constant input and values v c € JR of 
constant voltage such that 


( 10 ) (v c , n^v 0 ), rriooiv 0 ), h^v 0 )) 

is an equilibrium for the system ©. Equilibria (11011 are stable or unstable depending on whether c is 
below or above some critical value c*. Existence of this critical value has been proved by Rinzel and 
Miller [28], for the original model constants of Hodgkin and Huxley m which are slightly different 
from Izhikevich m- A numerical verification under the model constants of m is given in Endler ([8], 
fig. 2.6 on p. 28); it locates the critical value at c* ~ 5.265. In particular, the equilibrium point 

(11) (v° , noo(u 0 ), rriooiv 0 ), h^v 0 )) 
corresponding to c = 0 is stable. Its value computed numerically is v° ~ 0.0462. 
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We shall specify the fifth component (£j) in © in two ways: a CIR-type modelization and an OU- 
type one. We prove that in both cases all assumptions needed for Theorem [T| are satisfied. Both are 
biologically relevant: in Id integrate-and-fire neuronal models, rescaled CIR or OU diffusions have 
been used for a long time to model the membrane potential, see m and the references therein. In 
contrast to this we use CIR or OU as a model for the dendritic input. 


CIR-HH will denote the 5d system © for which the 5th equation takes the form 


( 12 ) 


d£t = W + ~ it] dt + \/ 6 ~ dW t , t > 0 , £ 0 = C > 0 

< 2a > 1 

t —>• S(t) nonnegative, real analytic and T-periodic . 


Assuming 2a > 1 and S(-) > 0, the process (£t)t> o starting from C > 0 almost surely never attains 0, 
and thus takes its values in the open half-axis (0, oo) on which the function y —>• yfiy is analytic. We 
shall consider the 5d CIR-HH process X = (X t )t >o defined by © + (fT2j) on the state space 

E := Mx [0, l] 3 x (0, oo) = M C m , C m = cl (G m ) with G m := (-m, m ) x (0, l) 3 x (—, m) . 

w m 

m 

Since ctj(-) and (3j(-) in © are strictly positive, the process X starting in C m \ G m+ \ enters G m+ \ 
immediately. Thus Assumption |T] does hold; we can take U := IRxIR 3 x(0, oo). 


Proposition 2 Assuming that 2 a > 1, Assumptions [H [3] and[3] are satisfied for CIR-HH with 

( 13 ) x* = (v*,n*,m*,h*,l) := ( v° , noo(u°) , m^v 0 ) , h^iv 0 ) , 1 ) . 

The proof for Proposition [2] is given in Section [5] below. We do not insist on scaling or on constants 
which are of interest for biologists m, ei, [12]): in view of proving ergodicity of the system, this 
does not make any difference, so we simplify and work with the form (11211 above. 

OU-HH will denote the system © for which the 5th equation takes the form 

( 14 ) dit = (5(f) -Ct)dt + dWt , t> 0 . 

We have considered in m a parametrized equation in view of biologically realistic modelization; 
we simplify here to (ED for the reason given above. We could prove in [14] that OU-HH admits a 
finite number of Harris sets, and in restriction to every Harris set is positive Harris recurrent with an 
’’explicit” invariant measure. In the present paper we are able to show that in fact a stronger assertion 
holds true: OU-HH admits a unique Harris set, as a consequence of Theorem [T] above. To show this 
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we have to check the assumptions of Theorem [0 We consider the 5d process X = (W)t>o defined by 
m+m on the state space 

E := M x [0, l] 3 x 1R = , C m = cl (G m ) with G m := (—m,m) x (0, l) 3 x (—m,m) . 

m 

By the same argument as above, Assumption Q] holds, with U := 1R x 1R 3 x 1R. 

Proposition 3 Assumptions OJ 0 and[7] are satisfied for OU-HH with 

(15) x* = (v*,n*,m*,h*, 0) := ( v° , n oo (u 0 ), moo(r°), hoo(v 0 ), 0) . 

See Section [5] for the proof. We insist on the fact that choice (Esd is different from our choice in 
fT4| (where constant input c ~ —0.0534 was chosen such that the voltage v c = 0 equals zero, and 
where v c = (0, rioo(O), moo(0), hoo(0)) was considered in the first four components of x* which leads 
to different properties of the control, cf. m section 2.4). We sum up the above discussions in the 
following theorem, immediate from Propositions [2] and [3j 

Theorem 2 CIR-HH (under the assumption 2a > 1) and OU-HH are positive Harris recurrent pro¬ 
cesses for which Theorem Q] and Corollary [7] hold. 

2.4 Limit theorems: an empirical distribution function for the interspike times 

Positive Harris recurrence allows to speak of spiking characteristics of the neuron in a sense of strong 
laws of large numbers. Interspike times are a notion of major interest in neuroscience. We stress that 
data (intracellular recording of the membrane potential in a cortical neuron in good time resolution) 
show that the time where a spike begins or the time where it ends cannot be identified from behavior 
of the variable v taken alone, e.g. in form of thresholds for v (which do not exist) or in form of other 
simple criteria based only on observation of v. The Hodgkin-Huxley model accounts for this since the 
gating variables n, m, h are responsible for opening or closing of ion channels. During an interspike 
time, we observe m < h, during a spike we observe m » h (more exactly: m close to 1 and h small), 
at the end of the spike we observe again m < h. The time interval on which m < h holds includes both 
a kind of refractory period immediately following a spike and then a waiting time up to occurrence of 
a new spike. We shall characterize the spiking activity through stopping times defined in terms of h 
and m. This is for large t approximately equivalent to a characterization in terms of the past of v, as 
a consequence of representations (41) in [13] for the gating variables j € {n, m, h} 

(16) j t = jo e~ Jo ( a j+M( v «) ds + f* aj (v r )e-fr(<*j+PAM ds dr j t >0 

Jo 
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where the influence of the starting value vanishes as t oo. This shows also that gating variables 
in a stochastic Hodgkin-Huxley model © have C 1 -paths. Let X t = (X t )t> o denote either CIR-HH or 
OU-HH as in the preceding subsection. Define events 

F sp : = {x = (v,n,m,h,() € E : m > h} , F b := {x = (v,n,m, h, £) € E : m < h} 

with subscripts for ‘spike’ or ‘between successive spikes’, then introduce stopping times by cjq = 0 and 

(17) T n : = inf {t > cr n _i : X t € F sp } , a n := inf {t > r n + 5 : X t <E F b } , n > 1 , 

where we think of 6 > 0 as a deterministic refractory period (this period, during which the neuron is 
not able to respond to any stimulus whatsoever as observed by biologists, cf. provides a key tool 
for the proof of Theorem [4] below). The sequence (r n ) ne iv marks on the time axis the beginning of 
successive spikes. It will be such that r n < oo for every n and T n | oo as n —>• oo, almost surely, as a 
consequence of the following theorem. 


Theorem 3 For CIR-HH under the assumption 2a > 1 or OU-HH, for all x € E : 

a) Q x ( there exists an infinite number of spikes ) = 1. 

b) Q x { there exists an infinite number of intervals [kT , (k + 1)T[ on which no spike appears ) = 1. 


The proof of Theorem [3] follows from support properties established in [T3j and is given in Section [5] 
below. Immediate applications of Theorem [T| and Corollary Q] a) to CIR-HH and OU-HH are the 
proportion of time spent spiking (or in F sp ) by 

1 . n ' \ ft 1 fT 

iim — V \crj-Tj) = lira - / l F (X s )ds = - / ds [iiP 0 . s ](F sp ) 
n ^°° T n t-*- 00 t J 0 p T J 0 

or the specific shape of a spike by means of test functions if through 

\J i>i x l) 1 F ap (X s )ds = ^ ^ J^ds[pP 0 ^\(dx)'if(x 1 ) l Fap (x) 

almost surely. As an essentially different application of strong laws of large numbers, far beyond (and 
not deducible from) Corollary [T] and based on analyticity of all coefficients in CIR-HH and OU-HH, we 
shall consider below the distribution function of the length of interspike intervals. Successive interspike 
times have no reason to be independent, and we may have single spikes as well as spike bursts (this 
follows from Theorem 5 of m combined with the complex behaviour of deterministic Hodgkin-Huxley 
models). Positive Harris recurrence allows for the following Glivenko-Cantelli type result. 
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Theorem 4 For CIR-HH with 2a > 1 or OU-HH, consider empirical distribution functions for in¬ 
terspike times defined from the stopping times in m 

i n 

F n(t) ■= ~ 1 [0,t](' r J+l - T j) » t > 0 . 

U 3=1 

Then for every choice of a starting point x € E, we have Q x -almost surely as n —>■ oo 


sup 

t>o 


F n (t) - F(t) 


0 as n —>• oo 


where F is a proper distribution function. F(t) has the interpretation of a relative number of expected 
interspike times smaller than t over ’’typical” life cycles of X. 


Here ’’typical” refers to life cycles which we can construct by Nummelin splitting, cf. [233 • The proof 
of Theorem [31 given in Section [5j works thanks to analyticity of the coefficients. 


3 Control systems. Weak Hoermander dimension 


In the sequel, given an SDE dYt = 5(t, Yt)dt + Y,(Yt)dBt driven by Brownian motion B in the Ito sense, 
we have to pass to its Statonovitch form dYt = d(t, Yt) dt + E(Y)) o dBt with Stratonovich drift 

m d 

2 


1 m f)Yi 

(!8) F (t,y) = S l (t,y) - > 1 < i < d 


1=1 3 =\ 


dx J 


(cf. Kunita [T^ p. 60, Bass [3] p. 198-199). 


3.1 Control systems: extension of the support theorem 


The control theorem goes back to Strook and Varadhan [29]. We quotqj it in the form Millet and 
Sanz-Sole [23], theorem 3.5. Consider an SDE dY t = S(t, Y t )dt + Y,(Y t )dB t , with state space E = M d , 
m < d is the dimension of the driving Brownian motion ( Bt ). All components of E(-) are C 2 on M d , 
bounded with bounded derivatives of orders 1 and 2, and 5(-, •) is globally Lipschitz and bounded on 
TT x lR d (cf. condition (H) of 


For time horizon to < oo which is arbitrary but fixed, write H for the Cameron-Martin space of 
measurable functions h : [0, to] -> dR m having absolutely continuous components h ( (t) = h f (s)ds 
with Jq° [h ( ] 2 (s)ds < oo, 1 < t < m. For x € ]R d and hgH, consider the deterministic system 

(19) ip = p( h,x ' > solution to dip(t) = 6(t,ip(t))dt + Y*(ip(t))h(t)dt, with starting point y?(0) = x. 

1 time-dependent drift does not alter the structure of proof in J23]; see also remark 2.2 and (4.2)-(4.3) in [29]. 
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Thus ip is a function [0, to] —> dR d - The control theorem states that in restriction to finite time horizon 
to, the support of the law of ( Y t )o<t<t 0 with starting point Yq = x coincides with the closure in 
C([0, to], lR d ) of the set of control paths 

This follows from approximation of Stratonovich integrals by adapted polygonal interpolation of the 
driving Brownian path, and from Girsanov theorem. Polygonal interpolation means that there is some 
-sufficiently fine- finite partition 0 = so < si < ... < s u = to such that all components h 1 in (fl9l) 
remain constant between s r _i and s r . Such controls h are called admissible by Arnold and Kliemann 
P]; in particular the support of the law of ( Yt)o<t<t 0 starting from Yq = x coincides with the closure 
in C([0, to], lR d ) of the following subset A x of A x : 

A x := | (ip( h,x \t)j : h£H admissible 

Extending this result to processes X with state space E C JR d according to Assumption [H by using 
localization, we obtain the following result. 

Theorem 5 Grant Assumption Q Denote by Qf? the law of the solution (X t )o<t<t 0 of (fTj). starting 
from Xq = x. Let ip = ip(whenever it exists) denote a solution to 

(20) dip{t) = b(t,ip(t))dt + a(ip(t)) h(t) dt , p(0)=x. 

Then the following two assertions hold true. 

a) Fix 0 < to < oo, x € E and h € H such that ip = ip( h ’ x '> exists on some time interval [0, T] for 
T > to and takes values in int(E) on ]0, T]. Then 

b) For h : [0, oo) —>• M m piecewise constant and without accumulation of jumps in finite time and for 
all x € E, ip = ip^L’ x l exists and takes values in E on some interval 

0 < t < s(h, x) , 0 < s(h, x) < oo . 

Then for all 0 < to < oo and x € E, the support of is contained in the closure of 

(21) | (^’^(i)) : h € H admissible and satisfying s(h, x) > to 

in the sense of uniform convergence in C([0, to], E). 
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This theorem will be proved in the Appendix Section [6j To our best knowledge this localized version of 
the control theorem adresses a new type of problem (completely different e.g. from control in presence 
of reflexion, see [7] and ESI), arising from the link between topological properties of the state space 
and properties of the process formulated in Assumption [Q which itself is imposed by the structure of 
Hodgkin-Huxley equations. 


3.2 Weak Hoermander condition 


We grant Assumption [T] and put the SDE (JT]) in Stratonovich form 


dX t = b(t,X t )dt + a(X t )odW t . 


Recall that all coefficients of equation dTJ) are C 00 —functions on 1R + x U for some open set U C lR d 
such that E C U. Consider the process X = ((ij'(t),Xt))t >o as in Section YT .II write U = TT x U and 
E = TT x E. In view of a representation dXt = Vo (Xt)dt + 1 VV(-Xt) o dWf for the process X in 

terms of the components W 1 ,..., W m of the driving Brownian motion in equation (pQ), we define (cf. 
Section 3.1 in m) vector fields on U taking values in ]R 1+d by 


V 0 (t,x) : = 


t 1 \ 

6 1 (t, x ) 


, V t (t,x):= 


( 0 \ 

a 1,£ (x) 


, 1 < £ <m , 


y b d (t,x ) J y a d ’ £ (x) 

that we identify with the first order differential operators 




3 =1 3 =1 

Given a vector field L : U —>• lR 1+d we denote by L l its components for i = 0 or i = 1,..., d. Whenever 
L has 0-component L° = 0, we have [Vo, L]° = [IV, L]° = 0 for 1 < £ < m and 


3 =1 


3 =1 


for i = 1, ...,d, with the usual notation for the Lie bracket of two vector fields [A, B] := AB — BA. 
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Definition 2 For fixed N G IV, define a set Cm of vector fields by ‘initial condition’ Vi, , V m € Cm 
and at most N iteration steps 

(22) Le£ N ^ [L, V 0 ], [L, Vi],..., [L, V m ] € C N . 

Write C* N for the closure of Cm under Lie brackets; its linear hull span (C^) is the Lie algebra LA(£jv) 
spanned by Cm- We define C := LA((J V Cm) and A := LA(Vo, Vi,..., V m ) . 

Note that all elements of C* N have 0-component equal to zero, so d is an obvious upper bound 
for dimspan(£jv), dim(LA(£jv)) and dim(£) on E. Now we can give the definition of full weak 
Hoermander dimension in Assumption [3j 

Definition 3 We say that a point x* G U D E is of full weak Hoermander dimension if there is some 
N G IV such that 

(23) dimspan(£jv)(s, x*) = d independently of s G TT . 


Up to uniformity in time on the torus, this is the usual form of the definition (cf. e.g. Hairer [9] Def. 
1.2). We have the following. 

Proposition 4 Under Assumptions 1 and 2 a), if points x* in int(U') of full weak Hoermander di¬ 
mension exist, then open neighborhoods U of x* exist in int(U) such that 

dimspan(£jv)(s, x) = dim(£)(s, x) = d for all (s , x) G TTxU . 

Proof of Proposition [4] 1) In analogy to Definition [5] consider for fixed N G IV a set of vector 

fields A at by ’initial condition’ Vo, Vi, ..., V m in A^v and at most N iteration steps 

L G A n =4- [L, V 0 ], [L, V],..., [ L , V m ] G A,v . 

Clearly Ajy D Cm for all N. By Proposition 1 in m and its proof, 

dimspan(Ajv(t, x)) = 1 + dimspan(£jv(£, x)) 

dim(A(t, x)) = 1 + dim(jC(i, x)) 

for all (t,x) G U. This is a consequence of the difference in the initialization between A m and Cm, 
since time dependence in equation m occurs in the drift only. 
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2) If a point x* £ U of full weak Hoermander dimension exists, fix x* and N as in Definition [3l By 1), 
span(AAr(t, x*)) has maximal dimension d+ 1 for all t £ TT. As a consequence, at (t, x*) for all t £ TT, 
span(AAr) coincides with the full Lie algebra A = LA(Vo, V\ ,..., V m ) viewed as a vector space. Then 
again by 1), span(£w) coincides with £ = LA(|J A r£jv) at (t,x*) for all t £ TT, and then also with 
span(£^) = LA(£jv) . 

3) Assume now that points of full weak Hoermander dimension exist in int(E), in the sense of Definition 

[3j For every v fixed, sets {(s,y) £ ITxmt(E) : dimspan(£ 7 v)(s, y) > v} are open. Since dimension d 
in (1231) is a maximal choice, the set {(s,y) € TTxmt(E) : dimspan(£jv)(S) y) = d} is open. • 


Remark 1 Proposition [7] and step 1) of its proof show that Definition (LWH) which we have used 
in m coincides with Definition 0 above up to uniformity in time on the torus. 


Example [T] continued Consider again the 2-dim process (0) driven by 1-dim Brownian motion on 
the state space E = 1R x [0, oo): then the point x* := (0, |) ; attainable in a sense of deterministic 
control for the process (EJj by Section 1 2.11 is of full weak Hoermander dimension if and only if the 
constant c > 0 in equation m satisfies c < |. Indeed, write x = (|,) for points in E, £ £ IR, ip > 0. 
With b(t,x ) = ( Chm J 27ri )S) as i n Section HOI we have to consider vector fields U lR 1+d 

1 2 Y 


V 0 = 


( l \ 

—c sin 2 (27rt) £ 

V 1 ~ / 


, V, = 


/ o \ 
1 

V ^) 


[Vb,LA] = 


0 

c sin 2 (27rt) 

1 


For x* = (0, |) € int(E) and t £ IT this simplifies to 


Vo (t,x*) = 


fl\ 

0 

V 0 / 


, V 1 (t,x*) = 


( n \ 


V I / 


Wo,Vi\(t,x*) = 


0 

c sin 2 (27rt) 
1 


Thus V\ and [Vo, Vi] are linearly independent at (t,x*) for all t if and only if c <\. In this case we 
have dimspan(£jv) = 2 = d on TT x {cc*} already for N = 1. 


3.3 Role of the attainable point 

If we specialize the control argument in Theorem [5] and focus only on time points which are multiples 
of the periodicity, relevant for the skeleton chain ( XjT)j£jN 0 i we have the following: 
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Corollary 2 Grant Assumptions^^ a) andQ For arbitrarily small neighborhoods U* of the attain¬ 
able point x* in int(-E) and for arbitrary starting points x € E, we have: 

Q x ( XjT € 17* ) > 0 for large enough j € JN . 


Proof To see this, choose 0 < to < °° arbitrarily large but finite and a control h € H, the Cameron- 
Martin space associated to to, such that the control path p>^) - [q, E connects initial value x to 
some terminal value in U*. We can do this such that t —>• tp( h ’ x \t) stays in U* over the time interval 
[it 0 ,t 0 ], cf. Definition [lj Then apply Theorem [5] and restrict to times t = jT in [^to,to]- • 

In the above result j may depend on x. In order to overcome this problem we introduce for fixed 
p g] 0, 1[ the transition kernel 

(24) R(x,dy) = (1 - p)'Y^p k ~ l P^ kT {x,dy) , 

fc>i 

corresponding to sampling the skeleton chain {X k T)k&iN 0 at independent geometric times. Let (Z^)^ e jv 0 
be the corresponding Markov chain. In order to prove positive Harris recurrence of the skeleton chain 
( X k T)k it is sufficient to prove positive Harris recurrence of the sampled chain (Zf)£. 

The following result is a main ingredient of the proof of Theorem [lj Its proof is given in Section 14.11 

Lemma 1 Grant Assumptions [7] 0 With x* from Assumption 0 both attainable and of full weak 
Hoermander dimension, fix some open set U C int(-E) containing x* such that the weak Hoermander 
condition holds on JJ. If U** C U is an arbitrary neighborhood of x*, we can find some ball C* := 
B e *(x*) and some point y* € U** with B e *(y*) C U** such that writing v* for the uniform law on 
B £ *(y*), Nummelin’s minorization condition holds (see and 

(25) R{x',dy') > a* l c*(x') i/*(dy') , x',y'eE. 


We would like to stress that Lemma [T] provides a substantial improvement over the type of result which 
we obtained in m ■ We worked there with a finite set of splitting conditions, see formulae (16)-(17) 
and Theorem 3 of m, and could establish the existence of a finite collection of disjoint Harris sets. 
In contrast to this, our route now works for a broader class of processes and establishes the existence 
of a unique Harris set. 


18 


3.4 The analytic case 


Throughout this section, we grant Assumptions [TJ [2] a) and[H In order to control X = ((7r(f), A f ))t>o 
of Section EH we view the functions appearing in Theorem 0 as (l+d)-dimensional functions 

[0,a(h,z)) 9 t —>■ := (i T (*),¥> (M) (t)) 

taking values in E = ITxE where TT = [0,T] is the torus, with initial value (0, x) G E. If h is 
admissible as in ( 1211 ) with constant components h £ (-) = , 1 < l < m, on intervals ]s r _i,s r ], the 

trajectory t —>• <^( h > x )(i) moves between times s r _i and s r along the vector field 

bo T Tl,rl / l T • • • T 7m,rKn 

where Vo and p, 1 < i < m, have been defined in Section 13.21 In this case Tp is a piecewise integral 
curve t —>• (p^ ,x \t ) of span(Vo, I j,..., V m ) in terms of Sussmann [30]. 

Lemma 2 Grant Assumptions [TJ [1 aj and[7} Then for 0 < to < oo arbitrary but fixed, the dimension 
of the Lie algebra LA(Vo, 1 1 ,..., V m ) remains constant along 

V {h ’ x) = (i T (-),V {h ’ x) ) : [0, t 0 ] —E 

if (p( h ’ x ) belongs to the set m, i-e. if h G H is admissible and satisfies s(h, x) > to • 

Proof Write for short S := span(Vo, Pi,..., Pn), S* for the closure of S under Lie brackets, and 
following Sussman [30], we write As» = LA(Vo, Pi,..., V m ) for the linear space spanned by S*. 

1) Sussmann [30] defines 5-orbits in E as equivalence classes of points in E under the following equiv¬ 
alence relation: (s,y) and (s' ,y') are equivalent if there is a piecewise integral curve of S connecting 
(s, y) and (s', y'), forward or backward in time. If we focus on a control function as in (1211) 

: [0, to] —> E with x € E and h € H admissible and such that s( h, x) > to 

we see that all points in the graph of ip ^ h,x ) are equivalent and thus belong to the same 5-orbit in E. 

2) By Assumption E 5 is a set of real analytic vector fields on U = TT x U. Thus by Sussmann [3(1] 
Section 9, the closure 5* of 5 under Lie brackets is ’’locally of finite type”. By Theorem 8.1 in |3L)| 
and the lines following its proof, this property implies that As* is 5*-invariant, i.e. As* coincides 
with Af, = Vs* in notation of m- The dimension of Vs* remaining constant along 5*-orbits (cf. pp. 
177 9 ~n anc j 176 10 _ 6 i n [30]), it follows that the dimension of As* remains constant along 5*-orbits. 
In particular, 

s —> dimAs*(^ (h,x) (s)) = dim LA(P 0 , Pi,..., P TO ) (i T (s), <p (h ’ x) (s)J 
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remains constant on [0, to] f° r all x G E and all h as in (|21D . 


We strengthen that the assertion of Lemma [5] hinges on Assumption 0 and would not hold true under 
our standing C°°-assumption (a counterexample is given in HO p. 177). Now we exploit Assumption 
0 combining the results of Section 13.21 with Lemma 0 we can prove 

Theorem 6 Under Assumptions^ 1 0 a), 0 and\Q all points x in the state space E are of full weak 
Hoermander dimension. 

Proof According to Assumption 0 fix x* in int (E) such that x* is attainable in a sense of deter¬ 
ministic control, see Definition 0 and of full weak Hoermander dimension, see Definition [3j 

1) Consider the sets of vector fields A = LA(Lo, Li,..., V m ) and C = LA(U^, Cn) on U = TTxU, with 
notations of Section [3T2l We have dim(A) = dim(£) + 1 on U by step 1) of the proof of Proposition 0 

2) Proposition 0 shows that dim(£)(s,x) = d for all (s,x) G 2T x U where U C int(.£7) is open and 
contains {x*}. Thus from 1), dimLA(Vo, Li,..., V m )(s, x) = d + 1 for all (s, x) G TT x U. 

3) By Definition 0 for all starting points x in E and arbitrarily small neighborhoods U* of x* in 
int(T'), we can find some time horizon 0 < to < oo and some control h G H, the Cameron-Martin 
space associated to to, such that the control path ip^ x > : [0, to] —> E connects an initial value (0, x) 
to some terminal value in TT x U*. Here we have degrees of freedom in choosing to and U*, hence the 
same property remains true in restriction to admissible controls h. The same can be done with initial 
values (s, x) € E. 

4) Along the control paths (p( h - x l : [0, to] —>• E of 3) which drive (s,x) into 1T x U*, with h£ H ad¬ 

missible and to large enough, dimLA(Vo, Li,..., V m ) remains constant by Lemma[2l This establishes 
dimLA(Vo, Li,..., V m )(s, x) = 1 + d for all (s, x) G E. Using again 1), we have dim(£)(s, x) = d for 
all (s, x) G E. • 


4 Proofs for Section 12.2 

4.1 Proof of Theorem [Q Local Lebesgue densities. 

We now give the proofs for Lemma [1] (which relies on Lemma[3]and Corollary [3] below) and Theorem 1. 
We quote the following from [El- 
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Lemma 3 Under Assumptions QH3] the following holds true. There exists an open neighborhood U 
of x* in int(i£) such that for 0 < t < oo, transition probabilities Po t t(x,dy) of the process (QP admit 
Lebesgue densities Po,t(x,y) locally on y € U with the following properties: U 3 y —>• po t t{x,y) is 
infinitely differentiable when x € E is fixed, and x —> Po,t(x,y) is lower semicontinuous on E when 
y € U is fixed. Moreover, for all measurable sets A C U and all t, the mapping x —> Pq^{x,A) is lower 
semicontinuous on E. 

Proof Our Assumptions [THS and Proposition 0] imply (HI), (H2) and (LWH) of m the assertion 
is from m, Theorems 1 and 2. The proof of Theorem 2 in m shows moreover that for all measurable 
sets A C U and all t, the mapping x — > Po,t{x, A) is lower semicontinuous on E. • 


Corollary 3 Under the assumptions of Lemma\f^ with U as there, the following holds true. 

a) The transition kernel R defined in admits transition densities r(x,y ) locally in y € U with the 
following properties: U 3 y —>• r(x,y) is lower semicontinuous when x € E is fixed, and x —>• r(x,y ) is 
lower semicontinuous on E when y G U is fixed. Moreover, for any measurable set A C U , x —>• R(x, A) 
is lower semicontinuous on E. 

b) For arbitrarily small neighborhoods U* C U of the attainable point x* of Assumption 0 and for 
arbitrary starting points x € E, we have that R(x,U*) > 0. 

c) The sampled chain (Zg)g e w 0 a T—chain in the sense of Meyn and Tweedie 

Proof Assertion a) is a direct consequence of Lemma [3] and of the definition of R. b) follows from 
Corollary [2j In order to prove c), observe that R(x,- n U*) is a continuous component of R in the 
sense of [2D, page 548, due to a), which is non-trivial due to b). • 


Proof of Lemma [l] With U from Lemma [3] and Corollary [3j we consider an arbitrarily small 

neigbourhood U** C U of the point x* from Assumption O 

1) We show (f25l) as a mere inequality. By a) and b) of Corollary [3l 



r(x*,y)dy > 0. 


As a consequence, there exists y* € U** such that r(x*,y*) > 0. By lower semicontinuity, this can be 
extended to small balls B e *(x*) and B e *(y*), where we can assume w.l.o.g. that B £ *(y*) C U**. 

2) It remains to check that C* := B e *(x*) is visited infinitely often by the sampled chain: then C* 
will be ‘small’ in the sense of Nummelin [25] . so (1251) will be Nummelin’s minorization condition (Ml) 
for the sampled chain. Let K c E denote the compact appearing in the Lyapunov condition of 
Assumption [2] b). Then for arbitrary choice of a starting point i£B, the skeleton chain (Xkx)k visits 
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K infinitely often, almost surely. The sampled chain (Zi)e, being ‘sampled’ out of the skeleton chain 
by tossing independent coins at times kT with success probability 1 —p, inherits this property. Thanks 
to Corollary [3] we know that x —>• R(x,C*) is lower semicontinuous and positive for any fixed x. As a 
consequence, since a lower semicontinuous function has a minimum on each compact set, we obtain 

inf R(x, C*) > 0. 

xGK 

Then Borel-Cantelli implies that the sampled chain 0 visits C* infinitely often, almost surely, 

for arbitrary choice of a starting point x £ E. • 

Proof of Theorem [l] It is sufficient to prove a), or equivalently, to prove positive Harris recur¬ 
rence of the sampled chain (Z^ e jv 0 , see [27]. Having proved Lemma Q] for the sampled chain, the 
Nummelin splitting condition (1251) implies Harris recurrence of the sampled chain (Nummelin [241 . 
[25]). It remains to show that recurrence is necessarily positive recurrence. The sampled chain being a 
Harris recurrent T—chain by Corollary [3] Theorem 3.2 a) of Meyn and Tweedie [21] shows that every 
compact set is a ‘petite set’. This holds in particular for the compact K in the Lyapunov condition of 
Assumption [2] b). Hence Assumption [2] b) corresponds to condition (DD2) of [21] . and Theorem 4.6 
of [21] finishes the proof. • 


4.2 Proof of Proposition [T| in the analytic case. Global Lebesgue densities. 

In case where the coefficients of m are real analytic functions we obtain stronger results. 

Lemma 4 Under Assumptions^ 0 and[^] the following holds true. 

a) For 0 < t < oo, transition probabilities dy) of the process (QJ) admit Lebesgue densities 

Po,t{x,y) with the following properties: y —>• po t t{x,y) is infinitely differentiable on int(E) when x £ E 
is fixed, and x —>■ po,t(x,y) is lower semicontinuous on E when y £ int(-E) is fixed. 

b) P 0 ,t is a strong Feller transition semigroup, i.e. Po,tf £ Co if f is a bounded 8—measurable function. 

Proof By Theorem [UJ the weak Hoermander condition holds on the full state space E, thus 
U = int(P) in Lemma [T] and in Lemma [3j In particular, for every measurable set A C U and 
for all t, the mapping x —>• Pqj(x,A) is lower semicontinuous on E. The boundary dE n E being 
entrance only, by Assumption 1 b), the last assertion extends to all A £ 8. As a consequence, for 
any positive and bounded 8— measurable function /, the mapping x —>• Pojf(z) is lower semicon¬ 
tinuous on E. We now use the following argument of Ichihara and Kunita j 1 (ij . proof of lemma 
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5.1, to deduce the strong Feller property of the semigroup. Putting / := ||/||oo — /, we conclude 
that Po,tf and hence —Po,t/ are lower semicontinuous. As a consequence, Po,tf must be continuous. • 


Proof of Proposition |T| By Lemma 01 /i = /xPq.t and all yPo, s admit Lebesgue densities. • 


5 Proofs for Sections 12.31 and 12.4 


We consider CIR-HH and OU-HH with all notations of Section 12.31 and give proofs for Propositions 
[2] and [3] and Theorems [3] and [U 

Proof of Proposition [2] 1) We have E = 1R x [0, l] 3 x (0, oo). Since all coefficients of CIR-HH 
are analytic on U if, Assumption 0] holds. By choice of S(-) in (1121) . Assumption [2] a) is satisfied. 
Let us now assume that 2 a > 1, select a nonnegative C 2 -function ip defined on (— 00 , 00 ) satisfying 
ip{y) := |y| when \y\ > 1, and prove that V : E —>• [l,oo) defined for all x = (x 1 , x 2 , x 3 , x , x 5 ) £ E by 

(26) V(x) : = 1 + log 2 (x 5 ) + (x 5 ) 2 + ipix 1 ), 

is a Lyapunov function for the skeleton chain (A^fcr)fceiVo i n the sense of Assumption [2] b). First, the 
fifth component (£t)t >0 in system (|5 ]) + (fl2]) . taken separately, has the Markov generator Ct given by 

| + (o + S(t)-* 5 )A + I s_JL_, 

Because of 2a > 1 and 5(-) > 0, we find positive constants ci,C 2 such that the function V : (0, 00 ) —» 
[1, 00 ) defined by V(x 5 ) := 1 + log 2 (x 5 ) + (x 5 ) 2 satisfies 

Ct F(x 5 ) < —ci R(x 5 ) + C 2 for all t > 0 and all x 5 £ (0, 00 ). 


Second, the 5d process (X t )t >0 has the Markov generator Ct given by 




■T \i,j 


(x) 


& 2 


i =1 


i,j =1 


dxidxj 


with notations of (fl|). ([5|l and (H2D. By definition in ([6|) there are positive constants d\ < cfo such 
that F(v,n,m,h) takes values between d\v and d2V when v + 00 , and between d/^v and d\v when 
v —>• — 00 , uniformly over n, m, h in [0, l] 3 . This results in positive constants ci, C 2 such that V : E —>• 
[l,oo) defined by (1261) has the property 

(27) Ct V(x) < —ci V(x) + C 2 for all t > 0 and all x £ E. 
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Localizing with r m := infjt : |V(Xf)| > m} asm-> oo, we deduce from (f27l) 


E x (V(X t )) < y(x)e“ ClT + [ T c 2 e~ Clt dt 

Jo 

(a well-known argument, cf. (2.2)-(2.4) in Mattingly, Stuart and Higham [20]) and rewrite this as 


Po,tV < AIL + 5 on E, 

for some constants 0 < A < 1 and 5 > 0. The function V : E —» [l,oo) being ‘bowl-shaped’, this is an 
essentially stronger assertion than Assumption [2] b). So far, we have checked Assumptions |TJ [2] and [4j 
2) We now turn to the key Assumption [3j We have to specify a point x* in int(-E) of full weak 
Hoermander dimension and attainable in a sense of deterministic control. Our candidate in int(-E) is 

x* = (v*,n*,m*, h*, 1) := (v°,n oo (v 0 ),m oo (v 0 ),h oo (v 0 ). l) . 


We have shown in m (see Theorem 3, Proposition 6 and Section 5.4 there) that any point whose first 
four coordinates coincide with (v°, Uoo(?; 0 ), m oo (u 0 ), /loo^ 0 )) is of full weak Hoermander dimension. It 
remains to prove that x* is attainable. Control systems t —>• tp(t) make use of Stratonovich drift. For 
CIR-HH, Stratonovich correction (1181) affects only the first and the fifth component: 

. 1 3 ( 7 ^ 1 -— '• 

b l (t,x) = b l (t,x) --a 5 (x)-^(x) = b l (t, x) - - , i = 1 , 5 , b l (t, x) = b l (t, x) , i = 2 , 3,4 . 


Hence, for every choice of a starting point x € E, we have to construct an h € L 2 oc which drives the 
5d trajectory ip = <p^ x ’ x > satisfying 


(28) 


= £v 5 ( s ) ~ F ((p 1 (s),ip 2 (s), <p 3 (s),ip 4 (s)) 
£p 2 (s) = a n ((p 1 (s))(l-cp 2 (s)) - /3 n (99 1 (s)) ¥ ? 2 (s) 

< |^ 3 (s) = a m (<^ 1 (s)) (1 - </? 3 (s)) - ^ m (^ 1 (s))<^ 3 (s) 

j- s p A {s) = a h (^ l {s)) (1 - </> 4 (s)) - p h {ip 1 {s))^ A (s) 

, S^ 5 ( s ) = [ a — I + S(s) — (f 5 (s) ] + VV 5 (*) h(s) 


from x = yj(0) to x* = lim <p(t ). For ease of notation we set a 

t—»oo 


a — 


l 

4 ' 


We start with an intuitive argument which is not yet a rigorous one. Consider x = (x l ,x 2 ,x 5 ,x A , £) € E 
where £ € (0, oo) is arbitrary. In order to push the fifth component of (128|) with initial value £ towards 
the desired limit 1, select a C°° function with the properties 





(e.g., apply a C°° smoothing kernel with support [—9,9] to t —>• (£ — t)\/l if C > 1, and tot (£ + i)Al 
if 0 < C < !)• Prescribing p 5 (t) := 75 ’^(i) for all t > 0, the hfth equation in 


dt 


<p 5 (t) = [a + S(t) — p 5 (t) ] + VW)^) 


with a := a — 4 determines a one-dimensional control h by 


h(t) := 


jt<p 5 (t) - [a + S(t) - p 5 {t)] 


~ [a + S(t)-^\t)] 


(C,i), 


t > 0 . 


With this choice for h, the coordinates (p 1 , p 2 , p 3 , p 4 ) of the control 


We have h € by 

system (12811 form a deterministic Hodgkin-Huxley system ED where constant input c is replaced by 
Since ■^'7^’ 1 \t) is in absolute value < 1 and vanishes for t > |£ — 1| + 1, this deterministic 
Hodgkin-Huxley system will make before and after time |£ —1| +1 at most a finite number of spikes and 
then spiral into the equilibrium point (u°, noo(u°), m oo (u 0 ), ^(u 0 )) corresponding to constant input 
c = 0 which is stable. It is here that our argument is not rigorous: for the deterministic HH with 
constant input c = 0 , we are not able to prove that indeed every starting point (v, n, m, h ) € Mx [ 0 , l ] 3 
belongs to the basin of attraction of (f°, noo(t: 0 ), m 00 (t; () ), ^(u 0 )). 

3) In the remaining part of this subsection we construct a different control which leads to a rigorous 
proof. This construction, much more lengthy than the previous heuristic argument, is organized in 


parts I) to VI) belowl^l Before going into the details, let us briefly describe the main points of our 
construction which proceeds roughly in three steps. The first step uses properties of the deterministic 
HH with constant input c = 0 in order to force the first coordinate ip 1 in (1281) into a ’’good” interval 
from which it will never escape again. It turns out that (—12,120) is such an interval. In a second 
step, we force the fifth component y ? 5 to attain sufficiently high values guaranteeing that it will never 
touch 0 during our construction. In this way, we ensure that tp 1 and p 5 take values in a ’’good” subset 
of the state space. At this point we start the main part of our construction, the third step, in which 
we first force p 1 into its limit value v*, during a fixed time period, and then use the fact that for fixed 
p 1 , the gating variables p l , i € {2,3,4}, converge exponentially fast to their respective equilibria. We 
now give the details of the construction. 

Part I) We collect some auxiliary facts. For F(v,n,m,h ) defined in © we have 


(30) sup \F(v,n,m,h)\ < f 

— 12<u<120, 0<n,m,h<l 

2 In fact, if we are not able to assert that every starting point ( v,n,m,h ) G _ff?x[0, l] 3 belongs to the deterministic 
basin of attraction of (v°, rioo(v 0 ), moofh 0 ), /ioo(h 0 )), for the deterministic HH with constant input c = 0, our control 
below together with the support theorem amounts to prove that arbitrarily small neighbourhoods of the point x* = 

(v°, noo(v°),moo(v°), hoofa 0 ), 1) in E can be attained with positive probability from every starting point ( v, n, m, h, Q £ 

E, at least after some long amount of time, in the CIR-HH process X defined by ©+©• 
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for some constant /, and ([6|) allows for bounds 


(31) F(v, 0,0,0)= inf F(v, n, m, h) if v > 120 , F(v, 0,0,0) 

n,m,h 


inf \F(v,n,m,h) | if u < —12. 

n,m,h 


Fix v € (—12,120), let m, n, h € [0,1] be arbitrary, let t —» ( nt(v),mt(v ), ht(v )) denote the solution to 


(32) 


£n s (v) = a n (y) (1 - n s (v)) - f3 n (v)fi s (v ) 

< i^Fi s (v) = a m (v) (1 - fh s (v)) - p m (v)m s (v) 
£h s (v ) = a h (v) (1 - h 3 (v)) - f3 h (v)h s (v) 


with initial value (re, m, h) at t = 0. Whenever there is no ambiguity about the value v which we keep 
constant we shall write (fit, frit, ht) for short. We see from (fT6|) -t-(|8 j) and d6]) that there are positive 
constants C and A such that uniformly in ( v,n,m,h ) € (—12,120) x [0, l] 3 


(33) max { \n s - n a 0 (u)| , \m s - moo(v)\ , \h s - hoo(v)\} < Ce Xs 

(34) |F (y,n s ,m s ,h s ) - F(u,noo(u) 1 moo (^) 7 ^OO (v)\ < Ce~ Xs 


for all s > 0. 

Part II) Fix any starting value x = (u, n, m, h, C) in E. We now show that during some first phase of 
our control it is possible to keep (p 5 fixed equal to £ and force tp 1 into the interval (—12,120). 
i) Consider the deterministic HH system ([7]) with constant input c = 0 which corresponds to = 0 
in (f28l) . As long as its first variable p 1 takes values outside (—12,120), the term — F(p x , •, •, ■) in the 
first equation of (|28|) represents a back-driving force, and the bounds (13H allow to ‘decouple’ p 1 from 
the gating variables (p 2 , p 3 , p 41 ) in [0, l] 3 . Consequently 

(35) t\ := inf{t : (/? 1 (t) 6 (—12,120)} < oo. 


Inspection of the fifth equation of 


shows that keeping p 5 equal to C on [0, fi] amounts to prescribe 
~[a + S(s) - C] 


h(s) : = 


VC 


on this interval which is meaningful since ( > 0. 

ii) Once arrived within (—12,120), the deterministic HH with constant input c = 0 will never be 
able to leave this interval again. Actually a stronger result was proved in [8], proposition 1.8: a 
deterministic HH with initial first component in (—12,120) and time-dependent input c(t) dt such 
that —6.78 < c(t) < 32.82 for all t will never be able to leave this interval. This is again a consequence 
of bounds (1311) at the endpoints v = 120 and v = —12 of this interval. 

Part III) During some second phase ]ti, ^ 2 ] of our control, with t ,2 specified in (1371) below, we force p 5 
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beyond some suitably large positive threshold, and we take advantage of Part II) ii) to make sure that 
p 1 does not leave the interval (—12,120) during this phase. Choose K large enough such that 


(36) (K — 120 — 1)(1 + /) - j > 1 

with C , A and / the constants of (loTTI) . (fTTIi and (15U1) . Now we prescribe 

d 5 . . 1 — [a + 5(s) — </? 5 (s)l 

— p 5 (s) = 1 or equivalently h(s) := -- , fi < s 

ds Vp 5 (s) 

and stop this second phase of control at time 

(37) t 2 := inf{s : p b (s) > K(f + 1) } < 00 . 


Note that on [^ 1 ,^ 2 ] the first four components of (12811 coincide with the solution of a deterministic HH 
system with constant input c = 1. Its first component lies in (—12,120) at time t\. Part II) ii) applies 
and ensures that p 1 remains in (—12,120) on 

Part IV) Let us set pfo) '■= iy',n',m',h' , £'). By construction v' = p 1 (t2) € (—12,120) and = 
p 5 (t2) > K(f + 1 ). Next, during some time interval ^,£3] with t-,$ to be specified in (EH|) below, our 
control acts on p 1 and directs it towards the desired limit v* = v°; we will have to make sure that p 5 
remains positive during this phase to prevent cp from leaving the state space E. 
i) In analogy to (l29l) . we choose a C°°-function 71 = 7 ^ ,v : [£ 2 , 00 ) —> M satisfying 


(38) 


71 (^ 2 ) = v' 

< |^|(s) < 1 on [t 2 ,t 2 + \v' - u*| + 1 ) 
7 i(s) = v* on [^2 + \v' — u*| + 1 , 00 ) . 


As a consequence of (HU), v* = v° is strictly positive, hence we have \v' — u*| < 120 for all v' under 
consideration in this step. For the present phase of control we prescribe 


(^(s) := 7 ^ u ^(s) for s > t 2 . 


Plugging this into the first and fifth equations in (1281) . we specify the control as 

iJr + 7> 2 , V 3 , p A )-\a + S- p b ] 


(39) 


h : = 




for s > t 2 ■ 


Clearly our choice (|38D + (|39I) drives p 1 into the desired limit v* = v° and fixes it there, and clearly p 1 
does not leave the interval (— 12 , 120 ). 

ii) We have to ensure that p 5 remains positive. With h specified by (1391) . the first equation of (1281) 
combined with (l38l) + (l30l) shows 




for s > t 2 - 
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Therefore at time s := t 2 + 120 + 1 by (l37ll 

<p 5 {s) > ^ 5 (i 2 )-(l + /)(120 + l) > (K — 120 — 1)(1 + /). 

Since f 2 + 120 + 1 is an upper bound for all times t 2 + W — u*| + 1 which can be considered in (|38[) . 
the choice of K in (136p provides us with the following intermediate result: 

C 

(40) (^(s) = v* = v° and (p 5 (s) > 1 + — at time s = f 2 + 120 + 1 . 

A 

However s arising here is not yet the time at which we will stop the present phase of control. 

iii) On the time interval [s,+oo[, tp 1 remains fixed in v* = by choice in (13811 . the gating variables 
(p 2 , ip 3 , p 4 ) converge exponentially fast towards (n oo (v 0 ),m oo (v°), hoo(v 0 )) = (n* ,m *, h*) by (1551) . 
whereas the first equation in (1281) yields 

^ 5 (s) = -^<p 1 (s) + F((p],...,(p*) = 0 + F(<pl,...,(p 4 s ) for s>s. 

The crucial point in our present construction (in contrast to the controls which we did consider in 
El) is that F (v°,n oo (v 0 ),m oo (v°),h oo (v 0 )) vanishes, see © mu). This fact allows in combination 
with (|34D for a finite integral 

POO 

(41) <P 5 (oo) := <p 5 (s)+ / F (v°, n u (v°),m u (v°), h u (v 0 )) du 

J S 

together with a bound 

^-p b {s) > —Ce~ Xs for s>s. 
as 

Thanks to (14011 both last assertions imply for s > s 

(42) ^ 5 ( S ) > p b {s)-Cj\~ xt dt > <p 5 (~s)-j > (l + x)"X = I' 

Thus p does not leave the state space E for s > s and we have <^ 5 (oo) > 1. 

iv) If we recapitulate the arguments above, we see that the control defined so far drives ip towards 

(43) (v*,n*,m*,h*,(p 5 ( oo)) = (y°, n oo (u 0 ), moo(r 0 ), hoo(v°), p 5 (oo)) where ^ 5 (oo) > 1 

as t —>■ oo, whose first four components coincide with those of the desired limit x* = (v*,n*,m*, h*, 1) 
defined in (11311 above. However our argument is not yet finished, for two reasons. First y? 5 (oo) may be 
far from 1 which is the fifth component of x*. Second the integral contributing to (141 [1 keeps trace of 
the initial conditions, in contrast to what was required in (11311 -or in Definition [T] for the limit point 
x* for ip as t —>• oo. Therefore we stop the control constructed above at time 

(44) t 3 := inf {s > s : p 2 (s) € B e (n *), ip 3 (s) € B £ (m *), </? 4 (s) G B e {h*)} 
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where e > 0 is arbitrarily small but fixed. It remains to arrange for the fifth component and to get 
rid of last traces of the initial conditions. Introduce the notation 


99 ( 43 ) =: (u, n", m", h , (") where (' > 1 , n" € B e {n*) , m" € B e (m*) , h € B £ (h*) . 

Part V) During some time interval ]^ 3 , ^ 4 ] with 4 4 to be defined in 114711 below, we drive p 5 towards 
v* = 1 without altering much p 1 ,..., p A . For this, we prescribe the first component of p as 

^(s) ■= 72 (s) for se[t 3 , 00 ) 


where 72 is a C°° function supported by [ 43 , 00 ) with the properties 


(45) 


72 (Us) = 

-10 _fc < ^p-(s) <0 for 4 3 < s < t 3 + 1 


72 (s) = u° — 10 k for s > t 3 + 1 
for some k € IN large enough to ensure that 99(43 + 1) =: ( v° — 10 _fe , n !", m "', h '", ) satisfies 


(46) 


ri" € B 2£ (n*) , rri" € B 2e (m*) , h'" <E B 2s (h*) , C'" > 1 


Let us set v** := v°— 10~ fc . Using notation (1321) with v fixed to v**, define n s := n s (v**), rh s := fh s (v**), 
h s := h s (v**) for s > t 3 + 1, with starting value ( n , m!" , h"') at (t 3 + 1). According to rt33l) + (fM]) . 
these converge exponentially fast to n 00 (v**),m 00 (v**),h 00 (v**), and again we have 

-^-p 5 (s) = ^-p 1 {s) + F{p 1 .,p A ) = 0 + F(v**,n s ,m s ,h s ) —» F^v**) as s 00 , 
as as 

p^(t 3 -f 1 4 t) := Q'" + 0 + / F(v**,n u ,m u ,h u )du for finite time 0 < r < 00 . 

«/ ^3 + 1 

Foo being strictly increasing and Fqo^v 0 ) = 0 , see <[6])-([9|), we have F^v**) < 0 , hence the last integral 
as a function of r is eventually decreasing (with extremely small slope by suitable choice of k). During 
this phase of control, ((^ 1 (s), p 2 {s), p 3 {s), p 4 (s)) remains close to its value at time t 3 by (j4bl) - (l46j) and 
the behavior of n s ,rh s , h s above. We stop this phase of control at time 4 4 defined by 


(47) 


44 := inf{4 > t 3 : p 5 (t) = 1}. 


VI) What we have achieved so far, putting steps I)-V) together, is a control 99 which at time 44 attains 


(48) < piM) = (v* ±e, noo(v*) ±e, moo(v*) ±e, hoo(v*) ±e, 1) 

for some e > 0 depending on e > 0 and k € JN chosen above. Note that we can achieve (|48f) for e > 0 
arbitrarily small. From now on, the intuitive argument of step 2) above will be a rigorous one: we 
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know that the equilibrium point m is stable, and start an ultimate phase of control at time £4 in 
some point (14811 arbitrarily close to the equilibrium (1111) . Then with (p 5 = 1 on [£ 4 , 00 ) and a control 
h determined from = 0, a 4d deterministic Hodgkin-Huxley system with constant input c = 0 
indeed spirals into the desired equilibrium value ED, and we are done. • 

Proof of Proposition [3] For OU-HH with state space E = 1R x [0, l ] 3 x M defined by (l5p+ (fTTl) . 
we consider control systems ()28[1 with fifth equation replaced by T s V b («) = [S (s) - («)] + ■ The 

proof proceeds in analogy to the preceding one, essentially simplified since there is no need to divide 
by \[$ or to prevent pP from leaving the state space. See m for the Lyapunov function. • 

In order to prove Theorems [3] and 01 we go back to the notations of Lemma [1] in Section 13.31 

Proof of Theorem [3] 1) Consider C* = B e *{x*) and D* = B e *(y*) C U** as in Lemma 0) U** 

is an arbitrarily small neighbourhood of x*, and s* can be chosen arbitrarily small. For CIR-HH and 
OU-HH and any choice of a starting point x € E, we know from the proofs of Lemma[l]and Theorem[T] 
in Section HU that the skeleton chain (Xkj')keiNo visits the sets C* and D* infinitely often. 

2) Recall the ” chameleon property” of the stochastic HH which is able to mirnick with positive prob¬ 

ability on fixed time intervals the behaviour of deterministic HH’s with quite arbitrary smooth deter¬ 
ministic input t —> I(t). For x' = (y',n',m ', h',£') € D*, let YJ denote the deterministic HH with 
input /(•) starting from (V, n f ,m',h') at time 0, and write Xf = ( Y x ', I{y)dv ). If the system 

X. x ' does not leave E during [0, t], then { / € C([0, t\,E) : sup |/(s) — | < e } has strictly positive 

0 <s<t 

Q x /-probability for every e > 0, by Theorem 5 of j !3j . 

3) Starting from x' € D*, assertion b) follows from 2) since the first four components of x* coincide 

with the equilibrium point for the deterministic HH with constant input /(•) = 0 which is attracted 
to this equilibrium. Assertion a) follows from 2) if we choose t = k^T with ko € LV sufficiently large 
but fixed and /(•) = c sufficiently large such that the deterministic HH Y 3 ^ with constant input c will 
enter the spiking regime within a finite time (smaller than koT). • 

Proof of Theorem [4] Recall short notation x for (0, x) as starting point for X. If we can show 

(49) for every 0 < t < 00 fixed : F n (t) —> F(t) (^-almost surely as n —>• 00 , 

the remaining uniformity in t € M follows as in the classical Glivenko-Cantelli theorem for i.i.d. 
random variables ( 0 , 0 ). Recall that successive interspike times have no reason to be independent. 
1) For CIR-HH and for OU-HH, all coefficients of the process being real analytic, we can do Nummelin 
splitting directly in the skeleton chain: by Lemma 0] we have continuous Lebesgue densities on int(F') 
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and can find some y* € int(E) with Po, t(x*, y*) > 0, hence there is e* > 0 such that 


P 0)T (x',dy') > a* 1 c*{x') v*(dy') , x',y'eE 


holds with C* = B e *(x*), v* the uniform law on B e *(y*), and some a* > 0. This improves on Lemma 
[I] above (and on [13]) and yields a sequence ( R n ) n of stopping times increasing to oo such that R n + 1 
are renewal times for the skeleton chain £ — > Xgx which starts afresh from law v* at every time R n + 1. 
Count interspike intervals of length < t starting within the stochastic interval [RjT , Rj + \T[ by 

OO 

( 50 ) z j( t ) '■= 1 {R,T< n <Ri+\T} 1 fQ,tl(^+i ~ T d ■ 

1= l 

Interspike intervals having at least length 5 > 0 by definition in (117|) . 

Z j{°°) = 1 {R-,T < T ,. <R i+ iT} < 0(-)(Rj+i — Rj)T 

1= 1 

has finite expectation under Qj j, by positive Harris recurrence with invariant measure ~p. 

2) Keeping t in 115011 fixed, we choose k £ JN such that t < (k — 2 )T. Then Zj(t) is measurable w.r.t. 
F(R j+1 T+(k-2)T) and thus, the distance between successive renewal times being at least 1, measurable 
w.r.t. J r R j+k _ 1 T ■ As a consequence, 


(51) Zj(t) is J r R j+fc _ 1 r- measurable and independent of (X( Ri+fe _ 1+1)T+s ) s >o , 


since Rj+k- i+l in (15111 is a renewal time for the skeleton chain. Exploiting again Rj+k- i+l < Rj+k , 
dSUD and (l5Tjl imply that the rv’s (Zj+gk)e>i are i.i.d. for every fixed value of j. Thus 

1 nk i k ( ^ n —1 \ 

lim — Z m {t) = tV lira - V] Z j+ik ) = C Ejc(Zi{t)) 

n-to o nk k \ n-t oo n 

m = 1 j =1 \ £=0 / 

by the classical strong law of large numbers, with C some norming constant from choice of life cycles. 
3) Zj(oo) being Fr j+ ^-measurable and independent of (-T(_R j+ 1 +i)r+s)s>o whereas Rj + i+l < Rj+2 , 
both (Z 2 i(oo))g and (Zi + 2t(oo))e are by definition families of i.i.d r.v.’s. In analogy to 2) we obtain 
lim ^ 1 Zjipo) = CEjc(Zi(oo )). Combining 2) and 3), the limit of the ratios 


lim 

v—yoo 


v X)j=i z j{t) _ Ep(Zi(t)) 


bZj=i z j(°°) %(^i(oo)) 

exists Q x -almost surely for every x € E, and Theorem [3] is proved. 


= : F{t) 


6 Appendix: Proof of Theorem [5] 

In this appendix section we give a (somewhat technical and lengthy) proof for Theorem [5j Notations 
are those established before or during the formulation of Theorem [5] periodicity of the drift in the time 
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variable is not really needed. The only assumptions on the process X and its state space E are those 
stated in Assumption |T| In part a) of this assumption, we considered a strictly increasing sequence 
(Gm)m of bounded convex open sets in ]R d such that, with C m := cl(G m ), E = (J C m . According to 

m 

part b) and b’), dE n E is entrance, and from boundary points x € C m \ G m+ 1 , almost surely, the 
process X immediately enters G m+ By part c), stopping times T m = inf{f > 0 : X t £ C m } are such 
that T m | oo almost surely, for every choice of a starting point 

Proof of Theorem [5] b) We proceed by localization which works as follows. 

1) By part d) of Assumption [U the coefficients of SDE (JT() are defined and C°° on [0, oo)xf7, for 
some open U containing E = [j n C n . This allows to construct a second increasing sequence (U n ) n 
of bounded open convex sets such that C n C U n and cl (U n ) C U for all n € IV, and coefficients 
(£, x ) —>• b n (t , x ) and x —>• a n {x) defined for t > 0 and x € M d and satisfying 

b n (-, •) is bounded and globally Lipschitz on [0,oo)xlR d ; 

<r n (-) is C 2 on ]R d , bounded and with bounded derivatives up to order 2 ; 

< 

b n (t,x) = b(t,x ) on [0,oo)xI7 n+ i ; 
cr n (x) = a(x) on U n+1 . 

At stage n of the localization, we have deterministic controls (p n = tp'n’^ '■ [0, oo) —> ]R d solving 

(52) d<p n {t) = b n (t,<p n (t))dt + a n ((p n (t))h(t)dt , t> 0 , ip n { 0) = x 

for all x € M d and h : [0, oo) —> M m having absolutely continuous components h e (t) = ii e (s)ds such 
that h ( 6 Lj 2 oc , with b n (-,-) the Stratonovich form of b n (-,-). We have a unique strong solution X n to 

(53) dX n (t) = b n (t,X n (t))dt + a n (X n (t))dW t , t> 0 

driven by the Brownian motion W of equation ©• We suppose that X n is defined on the same 
measurable space (fl,A) as X, for every choice of a starting point x € IR d \ and we write P x for 
the unique probability measure on (fl,^4) under which all X n start from X n (0) = x. For arbitrary 
0 < to < cc and x € M d , [23] gives a control theorem for X n : the support of the law of X n up to time 
to starting from x is the closure in C([0, to], M d ) of the set 

A x := | (^)) : h€H admissible 

2 ) In the following steps 2), 3) and 4), we consider x € C n , m,l > n, and fh > m. 

We introduce stopping times T™ := inf{f : X m (t) ^ C/} and ‘stop’ control paths (15121) at deterministic 
times tf 1 = t”'(h, x) := inf{t : ipm’ x \t) (j Ci}. Note that a process X m may leave E in finite time: 
hence sup ; T™ as well as sup z ^(h, x) may be finite. 
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Recall the stopping times 7} = inf{t : X t ^ C)} from Assumption [lj Necessarily Xx m G C m on {T m < 
00 } since C m is compact. Then either Xx m G G m+ 1 , or Xt„, G C m \ G m+ 1 in which case (Aj’ m+s ) s >o 
has to enter G m+ 1 immediately, cf. AssumptionQ] In both cases, (A'r m + s ) s >o will spend some positive 
amount of time in the open set G m+ Hence T m < T m+ \ in both cases. As a consequence, we have 
Ti < T/_|_i on {Ti < 00 } Q x -almost surely for all l > n , together with 7} f 00 as Z —»• 00 (^.-almost 
surely by Assumption |TJ 


Paths of X m and X starting from x coincide up to (and even slightly beyond) time T m+ \ = T™ +1 . 
Paths of X^ and X m starting from x coincide up to time T m +i, and controls and coincide 

up to time C+iOb®) = C+lOb^)- 

Notice also that f"" 1 (h, x) = t"(h, x) since x € C n . 

3) Control paths for X m starting at points x € C n \G n+ 1 remain in C n+ \ during some time 

interval [0,to] of positive length to > 0. This is seen as follows: by [23] or step 1), paths of X m can be 
approximated by control paths ifm^ and vice versa uniformly in time 0 < t < to, for every to fixed; 
X m coincides with X up to time T m +i > T n+ \ > 0, and paths of X starting in C n \G n+ \ immediately 
enter G n+ \ by Assumption 1 . 


4) When x € C q and t q q+ 1 (h, x) < 00 , we have t™ +1 (h, x) > t q q+ 1 (h, x) for all m > q. To see this, 
put n := q + 1 and assume t™( h, x) < 00 (otherwise there is nothing to prove). A control path ipm 
leaving C n at time t™ has to visit points of d(C n ) which either belong to C n \ G n+ \ or to G n+ 1 ; in the 
first case, remains in C^+i for some positive amount of time, by step 3). Thus in both cases, 

needs a positive amount of time to leave C n+ 1 ; this happens at time t™ +1 < 00 . Thus t™ + i(h, a:) 
is strictly greater than f™(h, x) = i” _1 (h, x). 


5) For x € E and h G Lf oc , 
(54) ^(t) := 1 M 


define t (f) by pasting together controls 




(h,a:), 


defined so far: 
tpM(0) = x . 


i> 2 

Notice that for x G C n \ C n - 1 , the above sum starts with l = n — 1, for which t”lj(h, x) = 0 and 
t™ _ 1 (h, x) > 0. Recall also f](h, x) = t\~ 1 ( h, x) for all l > n, from step 2). Hence the above construction 
can be achieved on a time interval 


(55) 0 < t < s( h,x) := supf| + 1 (h,x) < 00 . 

l 

For m>n and x G C n , t —»• p>^ x \t) defined in (pFl)) coincides with t —> on [0, t™ + 1 (h, x)] 

by step 2). Thus < p( h > x ') solves equation (1201) 

d<p(t) = b(t,ip(t))dt + a(<p(t))h(t) dt , <p(0) = x 
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up to time t™ +1 (h, x ). There is no reason that s(h, x) in (1551) should be infinite for all x € E, h £ Lf oc 


6 ) For every u ; fixed and every starting point x € E we can find some l such that X(t) € Gi for 
0 < t < 2to, with £ depending on ui and x. When x € int(£'), we have X(t) € int(-E') for 0 < t < 2to, 
d(E)nE being entrance by Assumption [T]b) , and the assertion follows from int(-E) = (J^ Gi , continuity 
of the path and compactness of [0,2fo]- When x € d(E) n E, we have x € Ci x \ for some £\. 

thus the path has to enter G ^ 1+ 1 immediately by Assumption [T] b’): then there is e > 0 such that 
X(t) € Ge 1+ \ for 0 < t < 2s, and we argue as above in restriction to the compact [e, 2to]- 


7) Fix x € C n and consider m > n. Viewing of (1521) as controls for X m on the time interval 

[0, 2fo], there is a sequence (h m (W)) m of adapted linear interpolations of the driving Brownian path 
(Wt)t >o with the property 


for every m > n : 


E n 


( sup 
V 0<t<2t 0 


X m (t) 


— <// h ’ 

rm 




(0 


< 2 


—3m 


To see this, recall that all equations (1531) . n > 1, are driven by the same W, and construct (h m {W)) m 
by extracting a subsequence from the sequence of adapted linear interpolations in (2.6)+(2.7) of [23]. 
Transform the last assertion into 


Px 


( sup 

V 0<t<2t 0 


X m {t') (p 


(h m{W),x) 
m 


(t) 


> 2 



< 2 m for all m > n . 


Since X coincides with X m up to time T m+ 1 , Borel-Cantelli then yields 


sup 

0<t<2t o 




< 2 “ 


for eventually all m 


P x -almost surely. Combining this last assertion with the result of step 6) we see that the event 


there exists some m < oo such that X t € Gf^+i for 0 < t < 2to , 


(56) 

has ^^-probability equal to 1. 


and sup 

0<t<2t o 


x(t)-<p!£r m ’ x \t) 


< 2 m for all m > m 


8 ) To conclude the proof, fix ui belonging to the event ([56]) . Note that X(t) € G ^+1 = hit(Cm+i) for 
0 < t < 2fo implies 2to < T^ +1 . Write for short f m := in (1331) . By step 7), f m is a control 

path for X up to time T m+ 1 , and leaves C m+ \ at time t™ +1 (h m (VF), x). All this depends on u. By 
definition in (|54j) . we can embed f m ^[o,t rn +1 (h rn (W),x)] i n t° ip^ hm ^ w ^’P which admits some (finite or 
infinite) life time s(h m (W), x). Steps 4) and 5) then show 


(57) 


s(h m (W),x) 


> t™ +1 (h m (W),x ) > t% +1 (h m (W),x) 
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if t*~ i+1 (\y m {W)i x) < oo, for every m > m. Keeping oj fixed, we have functions taking values in C^+i 
t —>• = , 0<t<ti +1 (h m (W),x) 

for m > fh, and a function 

t —> X(t) , 0 < t < T^ +1 

which for 0 < t < 2to < 1 remains in the interior Gf^+i = int(C^_|_i) by (15611 . From uniform 

convergence on [0,2io] as m —>• oo in (1561) we obtain 

21 0 < liminf t~ +1 (h m (TK), x) 

m 

and thus in virtue of (1571) 

2to < liminf s(h m (W),x) . 

m 

This establishes that the support of = C(X 1 [o,* 0 ] I Px) hi the sense of uniform convergence in 
C([0,to\, E) is contained in the closure of 

</?( h,x )(t) N ) : h £ H such that s(h,x) > to 

/ o <t<t 0 

and thus in the closure of (|21D . The proof of Theorem [a] b) is finished. • 


Proof of Theorem [5] a) The inverse inclusion now follows easily. Suppose that x € C n . Since 
y>( h,x )(s) £ int (E) for all 0 < s < T where T > to, there exists necessarily m>n such that £ 

G m+ 1 for all s e]0,T]. Applying step 5) of the first part of the proof, we know that coincides 

with on [0,t™ + 1 (h, x)\. Since t™ + 1 (h, x) > T > to, this implies that ip( h ’ x ^ = on [0,T], 

Applying step 2) of the first part of the proof, we obtain 


Vm X) \[0,T] S SU PP 


(q?' ¥ 


where Q™' T denotes the law of the solution (A t m ) 0<t< ^ starting from Xq = x. We also clearly have 
that (Xt n ) 0 < t <f stays in G m+ i with positive P x -probability. Since X™ = X t for all t < T m+ 1 , this 


implies that T m+ 1 > T with positive -Pr-probability, thus ~ £ supp 


(q 
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